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(57) ABSTRACT 

A sensory system and method for a visually impaired user 
includes an array of laser transmitters for transmitting laser 
signals in given areas corresponding to each of the laser 
transmitters. An array of laser sensors are provided for 
receiving laser signals reflected from objects in the corre- 
sponding given areas with each laser sensor corresponding 
to a respective one of the array of laser transmitters. The 
time between transmitted and received laser signals of a 
laser transmitter and the respective laser sensor is indicative 
of the distance between the user and an object in the 
corresponding given area. A processor is operable with the 
laser transmitters and laser sensors to effect scanning of the 
given areas by the array and to process the transmitted and 
received signals to determine the distance between the user 
and an object in the given areas. A feedback system is 
operable with the processor for generating a feedback signal 
for each of the laser sensors as a function of the received 
laser signals. The sensing system and method may also 
include an array of ultrasonic transducers. 

20 Claims, 2 Drawing Sheets 
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SENSOR FOR SIGHT IMPAIRED visually impaired user. The method includes transmitting 

INDIVIDUALS laser signals in given areas corresponding to respective 

positions. The laser signals reflected from objects in the 

TECHNICAL FIELD corresponding given areas are then received at the respective 

„ , , , 5 positions. The time between transmitted and received laser 

Hie present mvenlion relates generdly to obstacle detec- si ^ a , ^ tive ositions ^ of ^ dis . 

Uondev.ces for the blind and, more particularly, to a sensing Unce between ^ user ^ m objec , iQ lhe cortesponding 

array for the blmd. given area. 

BACKGROUND ART The transmission and reception of the laser signals at the 

10 respective positions may be enabled and disabled periodi- 

A variety of mobility aids have been developed to provide cally to effect scanning of the given areas. A feedback signal 

the blind with a means of traveling independently, is generated for each of the positions as a function of the 

confidently, and quickly. These aids include sensory devices received laser signal. 

for sensing potential obstacles. The sensory devices typi- ^ advantag es accruing to the present invention are 

cally transmit a signal in a beam towards an area and then is numerous . The sensory system provides a visually impaired 

listen to receive a signal reflected off of an object in the area. user ^ a footprint men tal picture of the environment by 

Because the propagation velocity of the signal is known, the scannill g horizontally and vertically across a sensor array, 

time between the transmit and reflected signals is indicative ^ ^ othef foa ^ embodiments of the 

of the distance of the object from the sensory device. presem ^ becQme ^ ^ regard 

A primary disadvantage with the pnor art is in "sensing" 20 to mc f 0 u owmg description, appended claims, and accorn- 

the space between objects, as well as sensing the general panying drawings, 
outline of the objects themselves. For example, a blind 

person walking down the street would like to distinguish BRIEF DESCRIPTION OF THE DRAWINGS 

between people, mail boxes, trees, etc., and of the gaps nG x {s a block ^ of m embodiment of the ^ 

between them. In essence, the blind person would like to be * m of ^ t mvcntion . 

able to form a mental picture or footprint of the surround- „ . L1 , . . . 

ing environment. The bhnd person would also like to be able 2 » a bl °* view 0 anoth t cr e ^odiment of the 

to form the mental picture from tactile stimulation and/or sensor y s y stem of the P resenl mventl0n ' 

auditory signals as quickly and accurately as possible. The FIG 3 illustrates two sets of vibratory feedback devices; 

prior art is devoid of such a sensory device. 30 FIG. 4 illustrates a glove for providing tactile feedback; 

FIG. 5 illustrates an audio alarm; and 

SUMMARY OF THE INVENTION FIG 6 ^ a block vicw of moihcv embodiment of the 

Accordingly, it is an object of the present invention to present invention, 

provide a sensory system which enables a visually impaired 35 BEST MODES FOR CARRYING OUT THE 

user to obtain a mental picture of the surrounding environ- INVENTION 
ment. 

It is another object of the present invention to provide a Referring now to FIG. 1, an embodiment of a sensory 

sensory system having an array of transmitters and sensors system 10 is shown. Sensory system 10 includes a v*or 

operable to enable the visually impaired user to obtain a 40 device 11 worn by a visually impaired user 12. V!Sor device 

mental picture of the surrounding environment. 11 ma y exlend ° n of " ser b « tweeQ . eaK °l lhe 

. . ., user to provide feedback on objects m front of the user. Visor 

It is a further object of the present invention to provide a deyice u ^ be confi d to be w d around the 

sensory system having an array of ultrasonic transducers. head and face of ^ n (nQt specifically shown) t0 provide 

It is still another object of the present invention to provide feedback on objects around the user. In this configuration, 

a sensory system having an array of laser transmitters and visor device 11 enables user 12 to have 360° peripheral 

laser sensors. vision. 

In carrying out the above objects and other objects, a Visor device 11 includes an array of laser transmitters 14 

sensory system for a visually impaired user is provided. The and laser sensors 16. As shown in FIG. 1, visor device 11 is 

sensory system includes an array of laser transmitters for 5Q divided into a plurality of segments. Each segment has a 

transmitting laser signals in given areas corresponding to transmitter 14 and a corresponding sensor 16. 

each of the laser transmitters. The system further includes an Transmitters 14 transmit laser signals along a highly 

array of laser sensors for receiving laser signals reflected directional beam at a given area in front of, or around, user 

from objects in the given areas with each laser sensor 12 Transmitters 14 are arranged and pointed such that each 

corresponding to a respective one of the laser transmitters. ss transmitter transmits toward a zone in the given area. 

The time between transmitted and received laser signals is Preferably, each transmitter 14 transmits a laser signal 

indicative of the distance between the user and an object in perpendicular to user 12. Thus, the given area is divided into 

the corresponding given area. a p i uraut y 0 f zones with each zone corresponding to one of 

A processor is operable with the laser transmitters and transmitters 14. 

laser sensors to effect scanning of the given areas by the ti0 Sensors 16 are operable to receive laser signals reflected 

array. The processor also processes the transmitted and from objects in the given area. Each sensor 16 corresponds 

received signals to determine the distance between the user to one of transmitters 14 and is operable to receive laser 

and objects in the given areas. A feedback system is operable signals reflected from objects in one of the plurality zones, 

with the processor for generating a feedback signal for each The time between a laser signal transmitted by one of 

of the laser sensors as a function of the received laser signal. 65 transmitters 14 and received by a corresponding sensor 16 is 

Further, in carrying out the above objects and other indicative of the distance between user 12 and an object 

objects, the present invention provides a method for a within the respective zone. 
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Sensory system 10 further includes a processor 18. Pro- ducers34 and received by that transducer is indicative of the 

cesser 18 includes a power supply for supplying power to distance between user 12 and an object within the respective 

transmitters 14 for transmitting laser signals. Processor 18 zone. 

processes the laser signals received by sensors 16 to deter- Processor 18 determines the time between transmitted and 

mine the time between transmitted and received signals. S received ultrasonic signals. Processor 18 then determines the 

Processor 18 then determines the distance between user 12 distance between user 12 and an object within a respective 

and an object within a respective zone of one of transmitters z °ne of one of transducers 34. Feedback system 20 is 

24 operable with processor 18 to generate a feedback signal for 

Processor 18 scans the array of transmitters 14. For each of 34 ■» a 6« ction ° f *» received 

SOniC signal 

instance, processor 18 controls the array such that one 30 y * # 

transmitter 14 transmits a signal while the other transmitters ™ e J"*"* signals provided by feedback system 20 

are idle. Processor 18 is further operable to determine if £!? ^ °? a of , f ° rms - * or msta ?f e - * s ? own m 

+ , * < ^ +a * FIG. 3, feedback system 20 may be operable with two sets 

sensor 16 corresponding to transmitter 14 receives a of a ^ of 44. Vibrators 44 provide 

reflected signal. Tins process is sequentially conUnued with tactUe stimulation t0 user 12 . S ets V(a-b) may be formed 

the next transmitter 14 transmitting a signal and the cone- 15 0Q m suiiMc for kcin Qn ^ hands of ^ of 

spending sensor 16 set for receiving a reflected signal, me face of ^ 16 Sets 42(fl _ fc) may a]so be mt0 

Preferably, array of transmitters 14 are swept along a me body of usei ^ vibrator 44 is associated with a 

horizontal sweep and then in a vertical sweep. To effect respective sensor 16 (or transducer 34). Thus, each vibrator 

scanning of transmitters 14, processor 18 enables and dis- 44 corresponds to a respective zone within the given area, 

ables each of the transmitters by turning on and shutting off 20 other feedback forms include force-surface pressure signals, 

the supply power to the transmitters periodically. a sensor 16 receives a reflected signal transmitted 

Alternatively, processor 18 is operable to provide con- by a corresponding transmitter 14, feedback system 20 

tinuous supply power to transmitters 14 so that the trans- stimulates that vibrator 44 associated with that sensor to 

mitters are transmitting signals continuously. In this alter- notify user 12 of the distance between him and an object 

native embodiment, processor 18 is operable to process all within a zone in a given area. Feedback system 20 stimulates 

of the reflected signals received by sensors 16. Processor 18 me various vibrators 44 as the array of transmitters 14 and 

then performs multiplexing, such as time division multi- sensors 16 are scanned so that user 12 can form a mental 

plexing (TDM), with the sensors 16 such that the sensors picture of the surrounding environment, 

scan the given area for reflected signals. Alternatively, 3o Feedback system 20 varies the stimulation of a vibrator 44 

processor 18 is operable such that each element of the array as a fu nct jon of the distance between user 12 and an object, 

continuously transmits and receives signals without scan- For instance, the frequency or magnitude of vibration may 

nm S- be varied as a function of the distance between user 12 and 

A feedback system 20 is operable with processor 18 to an object. A higher frequency or magnitude may imply that 

generate audible and/or tactile feedback signals for user 12. 35 the object is close to user 12. On the other hand, a lower 

The feedback signals are generated as a function of the frequency or magnitude may imply that the object is far from 

received laser signal, i.e., the distance between user 12 and user 12. Vibrators 44 may also be configured to apply heat 

an object in a zone associated with a respective one of and/or force-surface pressure as a function of the distance 

transmitters 14. From the different feedback signals gener- between user 12 and an object. 

ated during the scanning of the array of transmitters 14 4Q Referring now to FIG. 4, feedback system 30 is operable 
and/or sensors 16, user 12 may form a mental picture of the with a pair of gloves 46 (only one shown) for the hands of 
objects within the surrounding environment. Because of the user 12. Glove 46 is provided with muscle wires 48. Muscle 
large numbers and highly directional capability of transmit- ^res 4$ include shaped memory alloys (SMA), solenoid 
ters 14, sensory system 10 allows user 12 to distinguish switches, or the like. Muscle wires 48 tighten in response to 
objects in the given area by using the different feedback 45 a supplied voltage. Accordingly, each muscle wire is either 
signals. on or 0 fp and provides two bits of data. Glove 46 is shown 
Transmitters 14 and sensors 16 of the array may be in FIG. 4 as having three muscle wires 48 for each finger and 
scanned by electrical or mechanical means as known to thumb portion of the glove. Thus, each finger and thumb 
those of ordinary skill in the art. Of course, a single source portions have eight bits of data. Each finger and thumb 
transmitter/sensor pair may be used in place of the array and 50 portion of glove 46 preferably corresponds to one of trans- 
scanned by electrical or mechanical means. mitters 14 and sensors 16. In this case, the array of trans- 
Referring now to FIG. 2, an alternative embodiment of a mitters 14 and sensors 16 consists of ten transmitter/sensor 
sensory system 30 is shown. Sensory system 30 differs from pairs with each finger and thumb portion corresponding to 
sensory system 10 in that visor device 32 includes an array one of the pairs. 

of ultrasonic transducers 34 instead of laser transmitters 14 55 The eight bits of data provided by the three muscle wires 

and laser sensors 16. Transducers 34 transmit ultrasonic 48 is indicative of detected objects in the zone covered by 

signals and are arranged in an array such that each trans- the corresponding pair. For example, each bit may represent 

ducer transmits toward a zone in the given area. Thus, the three feet that an object in a zone is near user 12. Muscle 

given area in front of user 12 is divided into a plurality of wires 48 may be configured to provide different amounts of 

zones with each zone corresponding to one of transducers 60 tightening. For instance, muscle wires 48 may provide 

34. strong and weak tightening in addition to no tightening. In 

Transducers 34 are also operable to receive ultrasonic this case, each muscle wire 48 provides three (instead of 

signals reflected from objects in the given area. Transducers two) bits of information. As a result, twenty seven bits of 

34 have the same reception and transmission patterns so that data are provided by three muscle wires and each bit may 

a transducer receives ultrasonic signals reflected from an 65 represent one foot that an object in a zone is near user 12. 

object in a respective zone in the given area. The time Referring now to FIG. 5, feedback system 20 may also 

between an ultrasonic signal transmitted by one of trans- include an audio amplifier 56. Audio amplifier 56 is con- 
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nected to a pair of ear speakers 58(a-fe) by speaker cable 60. 
Audio amplifier 56 is associated with each of sensors 16 (or 
transducers 34) for providing audio feedback signals to user 
12. Other devices instead of pair of ear speakers S$(a-b) for 
providing the audio feedback signals to user 12 include a 
single ear plug, a "bone phone", etc. 

Audio amplifier 56 provides an audio feedback signal for 
a respective one of sensors 16. The audio feedback signals 
may have different tones (frequencies) for each sensor 16. 
For example, there may be twenty different tones for twenty 
sensors. 

Each audio feedback signal corresponds to a respective 
zone within the given area. When a transmitter 14 transmits 
and the corresponding sensor 16 receives a laser signal, 
audio amplifier 56 generates a particular audio feedback 
signal associated with that sensor to notify user 12 of the 
distance between him and an object within a zone in a given 
area. Feedback system 20 generates the various audio feed- 
back signals as transmitters 14 and sensors 16 are scanned 
so that user 12 can form a mental picture of the surrounding 
environment. 

Audio amplifier 56 varies the volume of the audio feed- 
back signals as a function of the distance between user 12 
and an object. A higher volume may imply that the object is 
close to user 12. On the other hand, a lower volume may 
imply that the object is far from user 12. 

Audio amplifier 56 may also provide audio feedback 
signals to user 12 as a function of the interaural volume. In 
this embodiment, audio amplifier 56 generates audio feed- 
back signals having ten different tones for two sets of ten 
sensors. Each tone is associated with a respective sensor in 
the two sets. Audio amplifier 56 varies the volume of the 
audio feedback signal provided to each ear as a function of 
the distance between user 12 and objects within the two 
zones corresponding to the two transducers. 

The feedback signals may be provided to user 12 in 
different patterns during scanning of the array of transmitters 
14 and sensors 16. Feedback system 20 may generate the 
audio feedback signal for a respective sensor 16 during the 
time that the corresponding transmitter 14 is transmitting a 
laser signal. The audio feedback signal is turned off once the 
associated transmitter 14 and/or sensor 16 is disabled. In this 
embodiment, the audio feedback signals follow the scanning 
of the array of transmitters 14 and sensors 16. For instance, 
stimulation of vibrators 44 moves horizontally and vertically 
across the hands of user 12 during scanning. Similarly, the 
tones of the audio alarm signals change during scanning. 

Alternatively, feedback system 20 may generate an audio 
feedback signal for a sensor 16 and then hold that signal for 
a period of time until the sensor receives a different reflected 
signal. Once a different reflected signal is received, feedback 
system 20 generates a new audio feedback signal. 

In another alternative embodiment, feedback system 20 
may generate an audio feedback signal for a respective 
sensor 16 and then hold that signal until a scanning cycle of 
the array of transmitters 14 and sensors 16 has been com- 
pleted. 

Referring now to FIG. 6, an alternative embodiment of a 
sensory system 60 is shown. Sensory system 60 includes a 
visor device 62 worn by user 12. Visor device has ultrasonic 
transducers 64. Sensory system 60 uses echo location simi- 
lar to that used by whales, dolphins, and bats. To this end, 
transducers 64 transmit ultrasonic signals for a given period 
of time. Transducers 64 then listen to receive ultrasonic 
signals which are reflected from objects around user 12. 

A processor 66 is operable with transducers 64 to perform 
signal processing. Processor 66 sums all of the received 
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signals from transducers 64 to form a sum signal. The sum 
signal corresponds to the objects surrounding user 12. Thus, 
the sum signal changes as the objects surrounding user 12 
change orientation and position, 

A feedback system 68 operable with processor 66 then 
shifts the frequency of the sum signal down to an audible 
frequency for user 12. User 12 then listens to the down- 
shifted frequency sum signal. By being able to differentiate 
the sum signals through training and experience, user 12 
may be able to form a mental picture of the surrounding 
environment. 

It should be noted that the present invention may be used 
in a wide variety of different constructions encompassing 
many alternatives, modifications, and variations which are 
apparent to those with ordinary skill in the art. Accordingly, 
the present invention is intended to embrace all such 
alternatives, modifications, and variations as fall within the 
spirit and broad scope of the appended claims. 

The embodiments of the sensory systems of the present 
invention share the feature of providing enough data to a 
user such that, through training and experience, the user can 
use the data to form a mental picture of the environment. In 
essence, instead of processing light for vision like sight 
unimpaired individuals, the sight impaired user processes 
the feedback data for vision. 

To this end, other sensory system embodiments, such as 
machine vision, may be utilized. For instance, information 
on the surrounding environment is processed by a machine 
vision computer. The computer can then process the infor- 
mation to form a signal indicative of the surrounding envi- 
ronment. Through experience, a sight-impaired user can 
distinguish among signals to form a mental picture of the 
surrounding environment. 

What is claimed is: 

1. A sensory system for a visually impaired user com- 
prising: 

an array of laser transmitters for transmitting laser signals 
in a total coverage area consisting of a plurality of 
given areas, each of the laser transmitters transmitting 
a laser signal in a corresponding given area; 

an array of laser sensors for receiving laser signals 
reflected from objects in the total coverage area, each 
of the laser sensors corresponding to a respective one of 
the array of laser transmitters for receiving a reflected 
laser signal from an object in the corresponding given 
area, wherein the time between transmitted and 
received laser signals of a laser transmitter and the 
respective laser sensor is indicative of the distance 
between the user and an object in the corresponding 
given area; 

a processor operable with the array of laser transmitters 
and laser sensors to process the transmitted and 
received laser signals to determine the distance 
between the user and objects in each of the given areas; 
and 

a feedback system operable with the processor for gen- 
erating a feedback signal for each of the laser sensors, 
the feedback system generating each feedback signal as 
a function of the distance between an object in the 
corresponding given area and the user, wherein the user 
uses all of the feedback signals corresponding to each 
of the given areas to establish a mental picture of the 
objects in the total coverage area. 

2. The system of claim 1 wherein: 

the processor is operable to periodically enable and dis- 
able the array of laser transmitters and laser sensors to 
effect scanning of the given areas of the total coverage 
area. 
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3. The system of claim 2 wherein: 

the feedback system generates the feedback signal for 
each of the laser sensors during the time that the 
respective laser transmitter is enabled. 

4. The system of claim 2 wherein: 

the feedback system generates the feedback signal for 
each of the laser sensors until the respective laser 
transmitter is subsequently enabled. 

5. The system of claim 2 wherein: 

the feedback system generates the feedback signal for 
each of the laser transmitters until a scanning cycle of 
the array of laser transmitters has been completed. 

6. The system of claim 1 wherein the alarm system 
comprises: 

a plurality of vibrators with at least one vibrator being 
associated with each of the laser sensors for generating 
a vibratory feedback signal for the respective laser 
sensor. 

7. The system of claim 6 wherein: 

the plurality of vibrators have a given frequency of 
vibration, wherein the given frequency of vibration is a 
function of the distance between the user and the object 
in the corresponding given area. 

8. The system of claim 1 wherein the feedback system 
comprises: 

an audio amplifier associated with each of the laser 
sensors for generating an audio feedback signal for the 
respective laser sensor. 

9. The system of claim 8 wherein: 

the audio feedback signal has a given audio frequency, 
wherein a given audio frequency is a function of the 
distance between the user and the object in the corre- 
sponding given area. 

10. The system of claim 8 wherein: 

the audio feedback signal has a given volume, wherein a 
given volume is a function of the distance between the 
user and the object in the corresponding given area. 

11. A method for a visually impaired user comprising: 
transmitting a laser signal in each of a corresponding 

given area of a total coverage area; 

receiving laser signals reflected from objects in the total 
coverage area, each of the reflected laser signals being 
reflected from an object in the corresponding given area 
with each received laser signal corresponding to a 
respective transmitted laser signal, wherein the time 
between transmitted and received laser signals is 
indicative of the distance between the user and an 
object in the corresponding given area; 

processing the transmitted and received laser signals to 
determine the distance between the user and objects in 
each of the given areas; and 

generating a feedback signal for each of the received laser 
signals, each feedback signal generated as a function of 
the distance between the object in the corresponding 
given area and the user, wherein the user uses all of the 
feedback signals corresponding to each of the given 
areas to establish a mental picture of the objects in the 
total coverage area. 

12. The method of claim 11 further comprising: 
enabling and disabling the transmission and reception of 

the laser signals periodically to effect scanning of the 
given areas. 

13. The method of claim 11 wherein: 

the feedback signal is a plurality of vibrations with at least 
one vibrator being associated with each of the received 
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signals for generating the feedback signal for the cor- 
responding given areas. 

14. The method of claim 13 wherein: 

the plurality of vibrators have a given frequency of 
vibration, wherein the given frequency of vibration is a 
function of the distance between the user and the object 
in the corresponding given area. 

15. The method of claim 11 wherein: 
the feedback signal is an audio signal. 

16. The method of claim 11 wherein: 

the audio signal has given audio frequencies, wherein a 
given audio frequency is a function of the distance 
between the user and the object in the corresponding 
given area. 

17. The method of claim 16 wherein: 

the audio signal has a given volume, wherein a given 
volume is a function of the distance between the user 
and the object in the corresponding given area, 

18. A sensory system for a visually impaired user com- 
prising: 

an array of ultrasonic transducers for transmitting ultra- 
sonic signals in the environment surrounding the user, 
each of the ultrasonic transducers further operable to 
receive ultrasonic signals reflected from objects in the 
surrounding environment; 

a processor operable with the array of ultrasonic trans- 
ducers to process the reflected ultrasonic signals 
received by the transducers, wherein the processor 
processes the received signals to form a sum signal; and 

a feedback system operable with the processor for gen- 
erating an audio feedback signal as a function of the 
sum signal by down shifting the frequency of the sum 
signal to an audible frequency, wherein the user listens 
to the audio feedback signal to determine objects in the 
surrounding environment. 

19. A sensing system for a visually impaired user com- 
prising: 

an array of ultrasonic transducers for transmitting and 
receiving ultrasonic signals in a total coverage area 
consisting of a plurality of given areas corresponding to 
each of the ultrasonic transducers, wherein the time 
between transmitted and received ultrasonic signals of 
an ultrasonic transducer is indicative of the distance 
between the user and an object in the corresponding 
given area; 

a processor operable with the array of ultrasonic trans- 
ducers to process the transmitted and received ultra- 
sonic signals to determine the distance between the user 
and objects in each of the given area; and 

a feedback system operable with the processor for gen- 
erating a feedback signal for each of the ultrasonic 
transducers, the feedback system generating each feed- 
back signal as a function of the distance between an 
object in the corresponding given area and the user, 
wherein the user uses all of the feedback signals 
corresponding to each of the given areas to establish a 
mental picture of the objects in the total coverage area. 

20. The system of claim 19 wherein: 

the processor is operable to periodically enable and dis- 
able the array of ultrasonic transducers to effect scan- 
ning of the given areas by the array. 
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